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TRAPEZOIDAL SHADOW MAPS 



Field of the invention 

5 

The present invention relates broadly to a method of deriving a shadow map 
for real-time shadow generation in computer graphical representation of a scene, a data 
storage medium and a computer system. 

10 Background 

Real-time shadow generation in computer graphics systems is gaining much attention 
recently due to the growing processing supports by powerful graphic processing units. In 
many applications, shadows are important because they add further realism to scenes and 
1 5 provide additional depth cues. 

Finding ways on how to calculate shadows started a few decades ago. We note that in 
most of the techniques there is a trade off between shadow quality and rendering time. Recent 
approaches are based on the standard shadow map algorithm (SSM). This two-pass algorithm 
20 is neat and easy to understand. In the first pass, the scene is rendered from the viewpoint of the 
light with depth buffer enabled. This buffer is read or stored into an image called shadow map. 
In the second pass, the scene is rendered from the camera viewpoint incorporating shadow 
determination for each fragment A fragment is in shadow if its z-value when transformed into 
the light's view is greater than its corresponding depth value stored in the shadow map. 

25 

The standard shadow map algorithm is easy to implement and is also fast in its 
calculation compared to other approaches. Additionally, its operations can be mapped and be 
executed efficiently in recent graphics hardware. A special texture is used for the shadow map 
and the shadow determination is performed with projective texture mapping. 

30 

On the other hand, SSM has a number of limitations. The first drawback is a resolution 
problem. The SSM works well when the light is close to the scene and to the viewpoint of the 
eye, but produces aliases around shadow boundaries when the light is far away. This is 
caused by low shadow map resolution in areas where a higher resolution is needed. Besides 
35 the practical scenario where only a small amount of texture memory is used to capture shadow 
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map, this problem can arise as the focus region of the eye's frustum contributes a very small 
fraction to the shadow map - whereas the remaining space in the shadow map that corresponds 
to those locations invisible to the eye's view is not utilised. 

5 Another limitation is referred to as polygon offset problem. Due to the image space 

property, shadow comparisons are performed with finite precision which causes the problem of 
self-shadowing. This can be addressed by finding a bias (and a slope factor) which is added to 
the depth values of the shadow map to move the z-values slightly away from the light We note 
that some approaches solve the resolution problem at the cost of worsening the polygon offset 
1 0 problem using a non-linear distribution of the depth values. 

Another limitation is referred to as a continuity problem where the shadow map 
quality changes significantly from frame to frame resulting in the flickering of shadows. 
This occurs in all modified shadow map approaches such as the bounding box 

15 approximation approach (see Figure 2) and the perspective shadow maps. Specifically, 
for example, perspective shadow maps rely on the convex hull of all objects that can 
cast shadows. This convex hull and the resulting shadow quality can change suddenly. 
In one case, this occurs when objects move into or out of the light's frustum in a 
dynamic environment. In another case, it can be observed when the algorithm virtually 

20 moves the position of the eye to avoid, for example, the inverted order of objects due to 
the perspective projection. 

Hence, it was with a view to balancing the above mentioned limitations that the 
present invention was conceived and has now been reduced to practice. 

25 

Summary 

In accordance with a first aspect of the present invention there is provided a 
method of real-time shadow generation in computer graphical representation of a scene, 

30 the method comprising defining an eye's frustum based on a desired view of the scene; 
defining a location of a light source illuminating at least a portion of the scene; 
generating a trapezoid to approximate an area, E, within the eye's frustum in the post- 
perspective space of the light, L; applying a trapezoidal transformation to objects within 
the trapezoid into a trapezoidal space for computing a shadow map; and determining 

35 whether an object or part thereof is in shadow in the desired view of the scene utilising 
the computed shadow map. 
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Generating the top and base lines l t and l b respectively, of the trapezoid to 
approximate E in L, may comprise 

- computing a centre line /, which passes through centres of the near and far 
planes of E; 

- calculating the 2D convex hull of E; 

-calculating l t that is orthogonal to / and touches the boundary of the convex hull 



of E; 
10 ofE 



-calculating & which is parallel to l t and touches the boundary of the convex hull 



In the case that the centres of the far and near planes of E are substantially 
coincident, a smallest box bounding the far plane may be defined as the trapezoid. 

Generating the side lines of the trapezoid to approximate E in L may comprise 

- assigning a distance dfrom the near plane of the eye's frustum to define a 
1 5 focus region in the desired view of the scene; 

- determining a point p L in L that lies on / at the distance d from the near plane of 
the eye's frustum; 

- computing the position of a point q on /, wherein q is the centre of a projection 
to map the base line and the top line of the trapezoid to y = -1 and y = +1 respectively, 

20 and to map p L to a point on y = ^, with \ between -1 and +1 ; and 

-constructing two side lines of the trapezoid each passing through q, wherein 
each sideline touches the 2D convex hull of Eon respective sides of /. 
In one embodiment, £ = -0.6. 

The desired point § may be determined based on an iterative process that 
25 minimizes wastage. 

The iterative process may be stopped when a local minimum is found. 
The iterative process may be pre-computed and the results stored in a table for 
direct reference. 

The method may comprise 
30 - determining an intersection 7, between the light source's frustum and the eye's 

frustum; 

- computing the centre point e of the vertices of 7; 

- defining a centre line l n passing through the position of the eye and e, for 
generating the trapezoid. 
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The method may comprise defining a new focus region which lies between the 
near and far planes of the eye's frustum that are geometrically pushed closer to tightly 
bound /. 

The trapezoidal transformation may comprise mapping the four corners of the 
5 trapezoid to a unit square that is the shape of a square shadow map, or to a general 
rectangle that is the shape of a rectangular shadow map. 

The size of the square or general rectangle may change based on a 
configuration of the light source and the eye. 

The trapezoidal transformation may transform only the x and the y values of a 
1 0 vertex from the post-perspective space of the light to the trapezoidal space, while the z 
value is maintained at the value in the post-perspective space of the light. 

The method may comprise applying the trapezoidal transformation to obtain the 
x, y, and w values in the trapezoidal space, x T , yr, and w T , and computing the z value in 
the trapezoidal space, z T , as z ^ z l' w t , where z L and w L , are the z and w values in the 

15 post-perspective space of the light, respectively. 
The method may comprise: 

- in a first pass of shadow map generation, 

transforming coordinate values of a fragment from the trapezoidal space 
back into the post-perspective space L of the light to obtain a first 
20 transformed fragment, utilising the plane equation of the first transformed 

fragment to compute a distance value of the first transformed fragment 
from the light source in L, z L i, adding an offset value to z L i, and store the 
resulting value as a depth value in the shadow map; 

- in a second pass of shadow determination, 

25 transforming texture coordinate assigned, through projective texturing, to 

the fragment from the trapezoidal space back into L, obtaining a second 
transformed fragment from the transformed texture coordinate, utilising 
the plane equation of the second transformed fragment to compute a 
distance value of the second transformed fragment from the light source 

30 in L, z L 2, and determine whether the fragment is in shadow based on a 

comparison of the stored depth value in the shadow map and Z|_2. 
The method may comprise 

- in a first pass of shadow map generation, 

during a vertex stage, transforming coordinate values of the vertex into 
35 the trapezoidal space, and assigning to the vertex the texture coordinate 
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equal to the vertex's coordinate values in the post-perspective space of 
the light, and 

- during a fragment stage, replacing the depth of the fragment with the 
texture coordinate of the fragment, adding to the depth an offset, and 

5 store the resulting value as a depth value in the shadow map; 

- in a second pass of shadow determination, 

- during the vertex stage, transforming coordinate values of the vertex 
into the post-perspective space of the eye, and assigning to the vertex 
two texture coordinates that are first the coordinate values of the vertex in 

10 the post-perspective space of the light and second the coordinate values 

of the vertex in the trapezoidal space, and 

- during the fragment stage, determining shadow of the fragment based 
on a comparison of the stored depth value in the shadow map, as 
indexed based on the second texture coordinate of the fragment, with a 

1 5 value based on the first texture coordinate of the fragment. 

The method may comprise: 

- in a first pass of shadow map generation, 

transforming coordinate values of a fragment from the trapezoidal space 
back into the post-perspective space L of the light to obtain a first 
20 transformed fragment, utilising the plane equation of the first transformed 

fragment to compute a distance value of the first transformed fragment 
from the light source in L, z u , adding an offset value to Zu, and store the 
resulting value as a depth value in the shadow map, 

- in a second pass of shadow determination, 

25 - during the vertex stage, transforming coordinate values of the vertex 

into the post-perspective space of the eye, and assigning to the vertex 
two texture coordinates that are first the coordinate values of the vertex in 
the post-perspective space of the light and second the coordinate values 
of the vertex in the trapezoidal space, and 

30 - during the fragment stage, determining shadow of the fragment based 

on a comparison of the stored depth value in the shadow map, as 
indexed based on the second texture coordinate of the fragment, with a 
value based on the first texture coordinate of the fragment. 



35 



The method may comprise: 
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- in a first pass of shadow map generation, 

during a vertex stage, transforming coordinate values of the vertex into 
the trapezoidal space, and assigning to the vertex the texture coordinate 
equal to the vertex's coordinate values in the post-perspective space of 
5 the light, and 

- during a fragment stage, replacing the depth of the fragment with the 
texture coordinate of the fragment, adding to the depth an offset, and 
store the resulting value as a depth value in the shadow map; 

- in a second pass of shadow determination, 

10 transforming texture coordinate assigned, through projective texturing, to 

the fragment from the trapezoidal space back into L, obtaining a second 
transformed fragment from the transformed texture coordinate, utilising 
the plane equation of the second transformed fragment to compute a 
distance value of the second transformed fragment from the light source 
15 in L, Zl2, and determine whether the fragment is in shadow based on a 

comparison of the stored depth value in the shadow map and z^. 
The method may further comprise adding a polygon offset in the determining 
whether an object or part thereof is in shadow in the desired view of the scene for 
representation utilising the computed shadow map. 
20 Two or more light sources may illuminate at least respective portions of the 

scene, and the method is applied for each light source. 

In accordance with a second aspect of the present invention there is provided a 
system for real-time shadow generation in computer graphical representation of a 
scene, the system comprising a processor unit for defining an eye's frustum based on a 
25 desired view of the scene; for defining a location of a light source illuminating at least a 
portion of the scene; for generating a trapezoid to approximate an area, E, within the 
eye's frustum in the post-perspective space of the light, L, from the light source; for 
applying a trapezoidal transformation to objects within the trapezoid into a trapezoidal 
space, for computing a shadow map; and for determining whether an object or part 
30 thereof is in shadow in the desired view of the scene utilising the computed shadow 
map. 

In accordance with a third aspect of the present invention there is 
provided a data storage medium having stored thereon computer code means for 
35 instructing a computer to execute a method of real-time shadow generation in computer 
graphical representation of a scene, the method comprising defining an eye's frustum 
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based on a desired view of the scene; defining a location of a light source illuminating at 
least a portion of the scene; generating a trapezoid to approximate an area, E, within 
the eye's frustum in the post-perspective space of the light, L, from the light source; 
applying a trapezoidal transformation to objects within the trapezoid into a trapezoidal 
5 space for computing a shadow map; and determining whether an object or part thereof 
is in shadow in the desired view of the scene utilising the computed shadow map. 



Brief Description of the Drawings 

10 

Embodiments of the invention will now be described, by way of example 
only, and in conjunction with the drawings, in which: 

Figure 1 illustrates a comparison between the shadows generated in the light's post- 
15 perspective space and in the trapezoidal space as described in an example 
embodiment. 

Figure 2 illustrates a comparison between the shadows generated in two consecutive 
frames by a bounding box approximation approach and a trapezoidal approximation 
20 approach as described in the example embodiment. 

Figure 3 illustrates a comparison between the shadow maps generated utilising the 
bounding box approximation approach and the trapezoidal approximation approach as 
described in the example embodiment. 

25 

Figure 4 illustrates the trapezoidal transformation taking place in the trapezoidal 
approximation approach as described in the example embodiment. 

30 

Figure 5 illustrates the trapezoidal transformation that maps focus region to within 80% 
of the shadow map as described in the example embodiment. 

35 Figure 6 shows the schematic diagram of the trapezoidal approximation approach as 
described in the example embodiment. 
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Figure 7 shows a plot of the areas occupied by the focus regions in the shadow map 
with a constant up vector of the eye while varying the angle between the eye's and the 
light's line of sight. 

5 

Figure 8 illustrates the quality of the shadows generated by the trapezoidal 
approximation approach as described in the example embodiment. 

Figure 9 is a schematic drawing of a computer system for implementing the method and 
10 system according to the example embodiment. 

Figure 10 illustrates the trapezoidal transformation and the four vertices of the trapezoid 
mapping the focus region to within 80% of the shadow map as described in the example 
embodiment. 

15 

Figure 11 illustrates the step of transforming the centre of the top edge of the trapezoid 
to the origin during calculation of the trapezoidal transformation matrix as described in 
the example embodiment. 

20 Figure 12 illustrates the step of rotating the trapezoid during calculation of the 
trapezoidal transformation matrix as described in the example embodiment. 

Figure 13 illustrates the step of transforming the intersection of the two side lines 
containing the two side edges during calculation of the trapezoidal transformation matrix 
25 as described in the example embodiment. 

Figure 14 illustrates the step of shearing the trapezoid during calculation of the 
trapezoidal transformation matrix as described in the example embodiment. 

30 Figure 15 illustrates the step of scaling the trapezoid during calculation of the 
trapezoidal transformation matrix as described in the example embodiment. 



35 



Figure 16 illustrates the step of transforming the trapezoid to a rectangle during 
calculation of the trapezoidal transformation matrix as described in the example 
embodiment. 
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Figure 17 illustrates the step of translating the rectangle along the y-axis during 
calculation of the trapezoidal transformation matrix as described in the example 
embodiment. 

5 Figure 18 illustrates the step of scaling the rectangle during calculation of the 
trapezoidal transformation matrix as described in the example embodiment. 

Figure 19 illustrates the final result representative of the trapezoidal transformation 
matrix as described in the example embodiment. 

10 

Detailed Description 

With reference to Figure 1 , an example embodiment of the present invention 
provides a method of calculating three Dimensional (3D) computer graphic shadows utilising 
15 trapezoidal shadow maps which are derived from trapezoidal approximations of the eye's 
frustums as seen from the light's view. 

Figure 1(a) shows the shadow map 102 of the scene 106 with 225 regularly 
spaced plant models 104 computed directly from the light's view or also known as the 
20 light's post-perspective space. As the light is far away, shadow aliasing appears in the 
view of the eye as shown in the shadow 108. Figure 1(b) shows the shadow map 110 of 
the scene 114 computed from the light's view after applying trapezoidal transformation 
to focus on the region (of only 15 plant models 112) which is potentially visible to the 
eye. As a result, a high quality shadow 1 16 is obtained. 

25 

In addition, with reference to Figure 2, the method of the example embodiment 
resolves shadow flickering caused by the continuity problem where the shadow quality 
changes drastically from frame to frame. In each of the four pictures, the post- 
perspective space of the light is on the top left e.g. 222, the generated shadow map on 

30 the top right e.g. 224, and the shadow of a plant 210, 212, 218 and 220 (as in the scene 
of Figure 1) on the bottom. Figure 2(a) shows the flickering of shadows (compare 
shadows 210, 212) from one frame i to the next frame i+1 generated by a standard 
bounding box approximation approach with the bounding box 204 of the area 202 
within the eye's frustum as seen from the post-perspective space of a light source. The 

35 shadow quality of shadow 212 is significantly poorer as compared to that of shadow 
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210. In contrast, Figure 2(b) shows a smooth shadow transition compare shadows 218, 
220 from one frame i to the next frame i+1 generated with the use of a trapezoidal 
approximation approach as described in the example embodiment. There is not much 
difference in the quality of shadow 218 and shadow 220. Furthermore, it can again be 
5 seen that the quality of e.g. shadow 218 is improved compared to e.g. shadow 210. 

Without loss of generality, the description assumes that there is a single light in 
the scene and the eye's frustum is completely within the light's frustum. In other words, 
there is a single light source that generates shadows. Other situations such as where 
10 the vertices of the eye's frustum lie behind or on the plane passing through the centre of 
the projection of the light and parallel to the near plane of the light will be discussed in 
the later part of the description. 

A shadow map can be viewed to consist of two portions: one within and the other 
15 outside the eye's frustum. It is recognised that only the former is useful in the 
determination of whether pixels are in shadow. Thus, to increase the shadow map 
resolution in one way is to minimise the entries occupied by the latter, collectively 
termed as wastage. Figure 3 shows an example of the trapezoidal approximation 306 in 
the example embodiment and a smallest bounding box approximation 308 of the area 
20 302 within the eye's frustum as seen from the light. One way to address the resolution 
problem is to better utilise the shadow map for the area 302 within the eye's frustum as 
seen from the light, herein referred to as E. This requires the calculation of an additional 
normalisation matrix N to transform the post-perspective space 300 of the light to an N- 
space, in general (where /V-space, refers to the trapezoidal space 304 or the bounding 
25 box space 310) in Figure 3. The shadow map is then constructed from the A/-space, as 
opposed to from the post-perspective space 300. During shadow determination, a pixel 
is transformed into the A/-space, rather than into the post-perspective space of the light, 
for the depth comparison. 

30 Intuitively, the closer the approximation is to Area E, 302 the better the 

resolution of the resulting shadow map. The smallest such area is the convex hull C 
of area E, 302. However, it is not clear how to efficiently transform C (which is a 
polygon of up to six edges) to a shadow map (generally a rectangular shape) while 
minimising wastage. 



35 
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The next natural choice is to use the smallest enclosing bounding box B 308 to 
approximate C for the purpose. However, a bounding box approximation may not 
always result in minimum wastage, as can be seen from a comparison of the bounding 
box space 310 with the trapezoidal space 304 in Figure 3. 

5 

In the example embodiment, a trapezoid is recognised to be a suitable shape to 
approximate area E, 302. More importantly, its two parallel top and base edges 
305, 307 form a surprisingly powerful mechanism to control the shape and the size of a 
trapezoid from frame to frame (as will be discussed later). This successfully 

10 addresses the continuity problem. Equally important and interesting for the choice of 
trapezoid in the example embodiment are its two side edges 309, 31 1 in addressing 
another kind of "implicit" wastage not mentioned in the above discussion. Such wastage 
is the over-sampling of near objects in the shadow map where a lower sampling rate 
would suffice. The example embodiment has an efficient mechanism to decide on the 

15 two side edges 309, 31 1 to spread the available resolution to objects within a specified 
focus region. In comparison, the transformation used in the smallest bounding box 8 
308 does not have such flexibility in stretching a shape. As a result, the smallest 
bounding box approach has a deteriorating effect on the shadow map resolution when 
the depth of view increases. 

20 

As mentioned, in the background section, the continuity problem is a 
consequence of a significant change in the shadow map quality from one frame to the 
next, resulting in flickering of shadows. For the smallest bounding box approach, the 
shadow map quality changes if there is a sudden change in the approximation of the 

25 area within the eye's frustum as seen from the light. Figure 2(a) shows from frame / to 
frame /+1 that the orientation of the approximation of the area within the eye's frustum " 
as seen from the light 202, 203 respectively with the smallest bounding box 204, 205 
respectively is changed. As a result, there is a drastic change to the resolution in 
different parts of the shadow map. In general, the problem can often occur when the 

30 eye's frustum as seen from the light transits from one shape to another different shape 
(where the number of side planes of the eye's frustum as seen from the light visible from 
the light's view is different). In contrast, in the trapezoidal approach of the example 
embodiment, Figure 2(b) shows from frame / to frame /+1 that no drastic change occurs 
to the resolution in different parts of the shadow map, compare shadows 21 8, 220. 

35 
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With reference to Figure 6, the example embodiment has an efficient and 
effective way to control the changes in trapezoids to address the continuity problem. 

The aim is to construct a trapezoid to approximate the area E, 602, within the 
5 eyes frustum as seen from the light with the constraint that each such consecutive 
approximation results in a smooth transition of the shadow map resolution. The strategy 
adopted in the example embodiment is to rely on a smooth transition in the shape and 
size of trapezoid to result in a smooth transition of the shadow map resolution. To begin 
with, the example embodiment makes computations to obtain the base and top line. 
10 From these, the base and top edge of the trapezoid are defined when the two side lines 
are computed. 

The following describes the computation to obtain the base and top line of the 
trapezoidal boundary on E t 602. 

15 

The computation is done to find two parallel lines in the post-perspective space 
of the light L, 600, to contain the base and the top edges of the required trapezoid. The 
aim is to choose the parallel lines such that there is a smooth transition when the eye 
moves (relative to the light) from frame to frame. 

20 

First, the eye's frustum is transformed into the post-perspective space L 600 of the light 
to obtain E, 602. 

Next, the centre line / 604, which passes through the centres of the near plane 622 and 
25 the far plane 624 of E 602 is computed. 

Next, the 2D convex hull of E 602 (with at most six vertices on its boundary) is 
calculated. 

30 Next, the top line l t 608 that is orthogonal to / 604 and touches the boundary of the 
convex hull of E 602 is calculated. The top line l t 608 intersects / 604 at a point closer to 
the centre of the near plane 622 than that of the far plane 624 of E 602. 

Then, the base line l b 606 which is parallel to (and different from) the top line l t 608 (i.e., 
35 orthogonal to / too) and touches the boundary of the convex hull of E 602 is calculated. 
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The above algorithm is such that the centre line / 604 governs the choices of l t 
608 and l b 606, with the exception for the case when the centres of the far and near 
planes (almost) are coincident. In the example embodiment, the algorithm handles that 
separately to result in the smallest box bounding the far plane 624 as the desired 
5 trapezoid. The next two paragraphs explain the rationale of the above algorithm to 
address the continuity problem. 

Imagine E, 602, the eye's frustum is drawn within a sphere with the centre of the 
sphere at the eye's position and the radius equal to the distance from the eye to each 

10 corner of the far plane 624. Suppose the eye's location does not change. Pitching and 
heading of the eye from one frame to the next can be encoded as a point (which is the 
intersection of / 604 with the sphere) on the sphere to another nearby point, while rolling 
of the eye does not change the encoded point but results in a rotation of eye's frustum 
along / 604. More importantly, with a smooth eye motion from frame to frame, the four 

15 corners of the far plane 624 of the eye's frustum lying on the sphere also have a smooth 
transition on the sphere. As the positions of / 604 and the mentioned four corners 
uniquely determine l b 606, it also transits smoothly from frame to frame. Similarly, l t 608 
transits smoothly from frame to frame, too. 

20 Next, suppose the eye's location does change relative to the light from one 

frame to the next but maintains its orientation. In this case, it is only a matter of scaling 
E, 602, and the l b 606 and l t 608 computed are parallel to the previous ones. In other 
words, both l b 606 and /, 608 again transit smoothly from frame to frame under a smooth 
translation of the eye's frustum. 

25 

Before describing the computation of the side lines, we first analyse the effect of 
transforming a given trapezoid in Figure 5(a) by its N T to a trapezoidal space. Note that 
N r has the effect of stretching the top edge into a unit length. In this case, the top edge 
is relatively short compared to the base edge, and therefore the stretching results in 
30 pushing all the shown triangles towards the bottom of the unit square as in Figure 5(b). 
This means that the region near to the top edge bounded by l t (608 in Figure 6) (i.e., 
close to the near plane (622 in Figure 6)) eventually occupies a major part of the 
shadow map. This results in an over-sampling in the shadow map for objects very near 
to the eye while sacrificing resolution of the other objects (such as the second triangle 
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502 to the fourth triangle 504 from the top in Figure 5(b)). This is the kind of wastage 
due to over-sampling as mentioned above. 

For the trapezoid 510 in Figure 5(a), its corresponding trapezoidal space 508 is 
shown in Figure 5(b). In the case of Figure 5(b), we obtain an over-sampling for a small 
region of E 506. In the case of Figure 5(c), for a different trapezoid computed with the 
80% rule (having the same top and base lines), its trapezoidal transformation maps the 
focus region 512 (the upper part of the trapezoid) to within the first 80% in the shadow 
map. 

Conversely, a small part of the shadow map is occupied by near objects when a 
"fat" trapezoid (having top and base edges of almost equal lengths) is transformed by its 
trapezoidal transformation. As the approach adopted by the example embodiment aims 
to achieve effective use of available shadow map memory by "important" objects in the 
eye's frustum, the algorithm to compute the side lines and thereafter compute the 
required trapezoid is as follows. 

Next, the computation of the side lines, which will form the side edges of the 
trapezoidal boundary on E, 602, will be described. 

With reference to Figure 6, assume the eye is more interested in objects and 
their shadows within the distance 5 from the near plane 622. That is, the region of focus, 
or simply the focus region, of the eye is the eye's frustum truncated at 5 distance from 
the near plane 622. Let p be a point of 8 distance away from the near plane 622 with its 
corresponding point p L 618, lying on /, 604, in L, 600. Let the distance of p L 618, from 
the top line be 8", 614. The example embodiment constructs a trapezoid to contain E t 
602, so that N T maps p L , 618, to some point on the line of 80% or what is referred in the 
example embodiment as the 80% line in the trapezoidal space (see Figure 5(c)). Such 
an approach is herein referred to as the 80% rule. 

To do this, a perspective projection problem is formulated to compute the 
position of a point q, 620, on /, 604, with q, 620, as the centre of projection to map pt, 
618, to a point on the 80% line y = § 610 (i.e. § = -0.6), and the base line 606 and the 
top line 608 to y = -1 and y = +1, respectively. Let X, 616, be the distance between the 
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base and the top line. Then, the distance of q, 620, from the top line, denoted as r\, 612, 
is computed through the following 1D homogenous perspective projection: 



Next, two lines passing through q, 620, and touching the convex hull of E, 602, are 
constructed to be the side lines containing the side edges of the required trapezoidal 
boundary. 

For some situations (such as the eye's frustum as seen in the post-perspective 
space of the light is a dueling frusta case), the 80% rule may result in a significant 
wastage of shadow map memory. Hence, in the example embodiment, the above 
algorithm is modified to an iterative process. Suppose the shadow map is a map with x 
horizontal lines of entries. (Examples of values of x in some applications are 512, 1024 
or 2048.) In the first iteration, a, 618, is mapped to the 80% line (or 0.8x), and in each 
subsequent iteration, p u 618, is mapped to an entry one line before that of the last 
iteration to compute q, 620. With each computed q, 620, a corresponding trapezoid and 
its trapezoidal transformation N T are computed as before. From all the iterations, the 
trapezoid, with its N T that transforms the focus region to cover the largest area (though 
other metrics are possible) in the shadow map, is adopted. In another embodiment, the 
iterations can stop once the value of x can be located where the focus region covers a 
local maximum largest area (or other corresponding metrics) in the shadow map. In 
other words, the iteration can stop once there is a change from a good coverage to a 
bad coverage, and use the good coverage to be the value of x. The above computation 
is not expensive as it involves simple arithmetic and only a small number of iterations. In 
fact, for a given up vector of the eye and a given angle between the eye's and the light's 
line of sight, the best £ 610, to where p u 618, is mapped is independent of the scene 
and can thus be pre-computed. Therefore, all these best % 610, (and thus r\, 612) can 
be stored in a table with the parameter of the angle between the eye's and the light's 
line of sight, for each possible up vector of the eye. Thus, in another embodiment, a 
simple table lookup can also replace the above iterative process. 




So, 



WO 2005/010827 



16 



PCT/SG2004/000230 



Figure 7 shows a plot 700 of the areas occupied by the focus regions in the 
shadow map with a constant up vector of the eye while varying the angle between the 
eye's and the light's line of sight. The focus regions occupy small areas for the dueling 
frusta case, but large area when, for example, one side face of E is visible in the light's 
view. 

To understand the 80% rule, the plot 700 of the total area covered by the focus 
region in the shadow map is generated by varying the angle (represented as a data 
point on the xy-plane) between the eye's and the light's line of sight while keeping the 
up vector constant. Experiments were done with a series of the same kind of plots with 
different up vectors. It was observed that consecutive plots of slightly different up 
vectors are surfaces of very close values. These plots indicate that there is a smooth 
transition on the area occupied by the focus region. This is a strong indication that the 
approach adopted by the example embodiment addresses the continuity problem well. 
Therefore, the 80% rule utilised in the example embodiment is effective. In another 
embodiment, one can adjust this percentage according to the need of the application. 

The above discussion assumes that the eye's frustum lies completely within the 
lighfs frustum, such as in an outdoor scene where the sun is the main light source. If 
this is not the case, one adaptation is to enlarge the light's view to include the eye's 
frustum. This is not an effective use of the shadow map. Also, this can be delicate to 
handle and may not always be feasible. There are also situations where the vertices of 
the eye's frustum lie behind or on the plane passing through the centre of projection of 
the light and parallel to the near plane of the light. Such vertices have inverted order or 
are mapped to infinity in L (600 in Figure 6). The next two paragraphs discuss a simple 
extension which avoids such situations. 

Specifically, it suffices to only transform the portion of the eye's frustum that is 
inside the light's frustum to L (600 in Figure 6). The remaining portion, which is not 
inside the light's frustum, is clearly not illuminated and hence cannot have shadows. 
Therefore, in the example embodiment, only the intersection / between the light's 
frustum and the eye's frustum (with no more than 16 intersections as its vertices) are 
processed. This conveniently avoids the above problem due to the perspective 
transformation. 
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The line / (604 in Figure 6) passing through the centres of near and the far plane 
of the eye's frustum may no longer be the centre line for the computation of the base 
and top line. One approach is to compute the centre point e of the vertices of /, and use 
the line passing through the position of the eye and e to be the new centre line l„ for the 
computation. A new focus region has to be defined, because the focus region may not 
be completely within /. One approach is to geometrically push the near plane (622 in 
Figure 6) and far plane (624 in Figure 6) of the eye (closer to each other) to tightly 
bound / in the world space to obtain f as the distance between those planes. Let f be 
the distance between the original far and near planes of the eye in the world space. 
Then, in one embodiment, the new focus region lies within the new near plane and its 
parallel plane, where the distance between the planes is (fflf). Note that 5 is the 
distance originally chosen to set the focus region. 

With the above, the approach adopted in an example embodiment is now suited 
for a wider range of applications: near to far lights, and both indoor and outdoor scenes. 
Figure 8(a) and (b) shows the displays of such cases with two lights illuminating a 
fantasy character. Figure 8(a) shows the character 806 lit by one nearby light 802 and 
two nearby lights 804 while viewed from outside the lights' frusta. Figure 8(b) shows the 
character 808 lit by a close light (left shadow 810) and a far light (right shadow 812) 
rendered by the trapezoidal approximation approach adopted by the example 
embodiment. From Figure 8, it can be observed that the approach adopted in the 
example embodiment can achieve high shadow quality for the close light situation as 
well as for the transition to the far light situation, which is unfavourable to the standard 
shadow map. 



The following description formalises the use of trapezoidal approximation in the 
approach adopted in the example embodiment. 

Refer to Figure 3. Consider a vertex v in the object space. Then, that vertex in 
the post-perspective space of the light L, 300 is v L = P L C L Wv where P L and C L are the 
projection and camera matrices of the light and W is the world matrix of the vertex. The 
eight corner vertices of E, 302, in L, 300, are obtained from the corner vertices of E, 302 
in the object space multiplied by P L C L Cd 1 where C E 1 is the inverse camera matrix of 
the eye. As illustrated in Figure 4, E, is treated as a flattened two Dimensional (2D) 
object on the front face 400 of the light's unit cube 404. We use a trapezoid T 402, to 
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approximate (and contain) E treated as the 2D object. A normalisation matrix N T is 
constructed such that the four corners of T, 402, are mapped to the unit square 401 or a 
rectangle. We call v T = N T - v L a vertex in the trapezoidal space, N T a trapezoidal 
transformation matrix, and the shadow map derived from the trapezoidal space a 
trapezoidal shadow map. 

The following describes the calculation of the trapezoidal transformation matrix 
N T in the example embodiment to map the four comers of T to a unit square. 
Analogously, one can calculate N T io map the four corners of T to a rectangle. 

With reference to Figure 10, the aim is to calculate a transformation N T (4x4 
matrix) which maps the four corners of the trapezoid 1000, f 0 , f,, f 2 , and f 3 to the front 
side of the unit cube 1002, i.e. to calculate A/ r with the following constraints: 
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There are a few ways to achieve this. A general approach is to calculate using 
quadrilateral to quad mapping.. Another way is to apply rotation, translation, shearing, 
scaling, and normalisation operations to the trapezoid to map it to the front side of the 
unit cube. The following illustrates a way to compute N r from a series of 4x4 matrices 
T u R, T 2 , H, S'i, N, T 3 and S 2 . In the following discussion, the vectors u = (x u , y„, z u , w u ) 
and v=(x v , y v , z v , w v ) hold intermediate results. 

As a first step, with reference to Figure 11,7, transforms the centre 1 1 00 of the 
top edge 1102 to the origin: 

r \ o o -x u ~\ 



Then, with reference to Figure 12, the trapezoid T 1200 is rotated by applying R 
around the origin in such a way that the top edge 1202 is collinear with the x-axis: 



it 





r x a y u 0 0> 

y u -x u o o 

0 0 10 

^0 0 0 1; 
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Next, with reference to Figure 13, the intersection / of the two side lines 1300, 
1302 containing the two side edges (f 0 , t 3 ) and (t u t 2 ) is transformed, by applying 7 2 , to 
the origin: 



us*-?!-*, and r 2 = 



(\ 
o 
o 

0 



o 
i 



10 



15 



20 



As a next step, with reference to Figure 14, the trapezoid has to be sheared with 
H, so that it is symmetrical to the y-axis, i.e. that the line passing through the centre of 
the bottom edge 1402 and centre of the top edge 1404 is collinear with the y-axis: 



o 

0 



1 

0 
0 



0 0 

1 0 
0 IJ 



Next, with reference to Figure 15, the trapezoid is scaled by applying S u so that 
the angle between the two side lines 1500, 1502 containing the two side edges (fe, f 3 ) 
and (f 1t t 2 ) is 90 degrees, and so that the distance between the top edge 1504 and the x- 
axis is 1 : 



u=H-T 2 -R T r t 29 and s { = 



0 
0 



0 

0 

0 



0 tf) 

0 0 

1 0 
0 IJ 



Next, with reference to Figure 16, the following transformation N transforms the 
trapezoid to a rectangle 1600: 



(\ 0 0 0^ 

0 10 1 

0 0 10 

v0 1 0 Oj 



Then, with reference to Figure 17, the rectangle 1700 is translated along the y- 
axis until its centre is coincident with the origin. This is done by applying 7* 3 . After this 
transformation the rectangle 1700 is symmetrical to the x-axis as well: 

u=NS r HT 2 RT t t 0i 

v=N.s r H-T 2 -R-T r t 2i and 
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*3 = 



0 0 1 
0 0 0 



Then, with reference to Figure 18, the rectangle 1800 has to be scaled with S 2 
along the y-axis so that it covers the front side of the unit cube 1900, as shown in Figure 
19: 



u=T 3 -N-s r H-T 2 -R T r t Qi and S 2 = 



fl 0 0 0^ 

0 -wjy u 0 0 

0 0 10 

[0 0 0 1 



Thus, the trapezoidal transformation N T can be computed as follows: 

N T ^S 2 T^N'S r H'T 2 RT l . 



Returning to Figure 4, in the example embodiment, the intent of N T is to 
10 transform only the x and y values of those vertices of objects. This transformation, 
however, also affects the z value of each vertex depending on its x and y values. Thus, 
a single offset for all vertices (as in the standard shadow map approach) may not be 
adequate to remedy surface acne effects. 



1 5 Figure 4 shows the trapezoidal approximation 402 of the eye's frustum within the 

light's frustum in the post-perspective space of the light. Figure 4 also shows the 
trapezoidal approximation under the trapezoidal transformation described above 
resulting in a unit square 401 (or rectangle) for the front view 405 but a trapezoid on the 
side view 409. This worsens the polygon offset problem. Figure 4 also shows an 

20 approach adopted by the example embodiment to maintain a unit square 407 for the 
side view 408 under the trapezoidal transformation. 



The trapezoidal transformation incorporates a two-dimensional projection. An 
important property of this transformation is that the z r of the vertex in trapezoidal space 

25 depends on the w T . In actual fact, the distribution of the z-values is changing over the 
trapezoidal shadow map so that a constant polygon offset as in the standard shadow 
map approach may not be adequate. The problem is that the specified polygon offset 
might be too high for pixels containing object near to the eye or might be too low for 
pixels containing object further away. If the polygon offset is too high it can happen that 

30 shadows are disappearing; on the other hand, if it is too low surface acne might be 
introduced. 
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By maintaining the depth value in the post-perspective space of the light in the 
example embodiment, a constant polygon offset may be specified similar to the 
technique used in the standard shadow map approach to combat the polygon offset 
5 problem. The distribution remains uniform, as can be seen from the unit square 407 
from the side view 408 in Figure 4. 

In one embodiment, to achieve this only the x, y and w values of each vertex are 
transformed by N T to the trapezoidal space (304 in Figure 3), while maintaining the z 
10 value in the post-perspective space L (300 in Figure 3) of the light In a simple form, the 
formula to transform a vertex to the trapezoidal space (304 in Figure 3) is now done as 
in v T = N T v l to get its x Tt y T and w T values, and then compute the z T value from the z 
and w values of v L , i.e. z L and w L , as: 

15 , r= £^. 

The above calculation can be implemented with a vertex program to compute the 
required z T during the first pass of shadow map generation, and another vertex program 
to compute the corresponding z r in L (300 in Figure 3) for each vertex during the second 
20 pass of shadow determination. This embodiment is easy to implement and practically 
workable. However, such an approach is only an approximation to the actual z values. 
When the eye or light frustums contain no particularly large triangles, such incorrect z 
value at each point of a triangle was found not to matter, as the error is small and thus 
negligible once it is adjusted with a relatively large polygon offset. 

25 

To improve on the above embodiment, other embodiments may utilise 
approaches based on ray casting, and/or based on multiple texture coordinates. Note 
that each approach has the usual two passes of the shadow map generation and the 
shadow determination. One can combine these approaches into four different 
30 combinations of methods to address the problem. 

In the ray casting approach, the fragment stage is used to compute the correct z 
value for each fragment in L (300 in Figure 3). In the first pass (shadow map 
generation), Nf 1 and the inverse viewport matrix to transform the x and y values of a 
35 fragment from the trapezoidal space back to L (300 in Figure 3) are used. After that, a 
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plane equation n in L (300 in Figure 3) of the fragment is used to compute the z value. 
This value is added with an offset and then stored into the shadow map. Then, in the 
second pass (shadow determination), N T ~ 1 is applied to the x Tt y T and w T values of the 
texture coordinate assigned to the fragment (through projective texturing) to obtain x L , y L 
5 and w L . With these values, the z value of the fragment in L (300 in Figure 3) is computed 
from 7v. This z value is to compare with the depth value stored in the (x^w z y7/w r )-entry 
of the shadow map to determine whether the fragment is in shadow. 

In the multiple texture coordinates approach, at the first pass (shadow map 
10 generation), the vertex stage transforms each vertex v to v T =(x r , y r , z Tt w T ) and assigns 
VL-ixu Vu Zu w L ) as its texture coordinate. The texture coordinates over a triangle are 
obtained by linearly interpolating the v L lw T values of the vertices of the triangle. Next, 
the fragment stage replaces the depth of the fragment with z L /w L and adds to it an offset. 
In effect, the z value of the vertex in the trapezoidal space is set as z L with the 
15 necessary polygon offset. In the second pass (shadow determination), the vertex stage 
transforms each vertex to the post-perspective space of the eye as the output vertex. It 
also computes, for the vertex, two texture coordinates v L =(x L , y L , z Ll w L ) and v T =(x r , y r , 
z r , w r ). Then, the fragment stage processes each fragment to determine shadow by 
comparing z L /w L to the value in the shadow map indexed by {xrlw Tt y-rlw T ). 

20 

Annexure A shows vertex and fragment program codes for implementing the 
trapezoidal transformation in an example embodiment. The approach adopted is the 
multiple texture coordinates approach described above. Only the shadow map 
generation step is shown, i.e. the first pass of the algorithm, because the second pass 
25 of the algorithm works in a similar way. The same functionality as in Annexure A can be 
achieved with, for example, other version of vertex and fragment programs or Cg or 
other computer graphic programs. 

Note that for the sake of clarity, the calculation of a constant polygon offset, 
30 which is added to the final depth value is omitted in Annexure A. 

Annexure B shows a display routine for use in an implementation of the 
described algorithm in an example embodiment. 

35 The example embodiment may be implemented using GNU C++ and OpenGL 

under Linux environment on an Intel Pentium 4 1.8GHz CPU with a nVidia GeForce 
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FX5900 ultra graphics controller. ARB vertex/fragment programs or Cg programs may 
be used to address the polygon offset problem. The shadow maps may be rendered into 
a pbuffer or general texture memory. The example embodiment uses various geometric 
yet simple operations such as convex hulls, line operations etc. in 2D, thus making 
5 robustness issues easy to handle. 

Embodiments of the present invention may provide the following advantages. 

Shadow map resolution is improved by approximating the eye's frustum seen by 
10 the light with a trapezoid and warping the trapezoid onto a shadow map. This increases 
the number of samples for areas closer to the eye and therefore results in higher 
shadow quality. 

The trapezoid is calculated such that a smooth change in shadow map resolution 
15 is achieved. The calculation is not computationally expensive as the trapezoid is only 
calculated based on the eight vertices of the eye's frustum rather than on the whole 
scene which eliminates the continuity problem occurring in all prior art. 

Furthermore, the trapezoidal approximation is a constant operation and the 
20 algorithm scales well. No doubt the warp contains a perspective transformation, where 
polygon offset becomes an issue. However, this problem can be resolved by one of the 
three approaches discussed in the example embodiment where utilisation of the 
vertex/fragment programs or Cg programs on modern graphics hardware is involved. 

25 It is appreciated that a person skilled in the art can easily apply the present 

invention utilising multiple light sources with a shadow map for each light source. 

The method and system of the example embodiment can be implemented on 
a computer system 900, schematically shown in Figure 9. It may be implemented 
30 as software, such as a computer program being executed within the computer 
system (which can be a palmtop, mobile phone, desktop computer, laptop or the 
like) 900, and instructing the computer system 900 to conduct the method of the 
example embodiment. 
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The computer system 900 comprises a computer module 902, input modules 
such as a keyboard 904 and mouse 906 and a plurality of output devices such as a 
display 908, and printer 910. 

5 The computer module 902 is connected to a computer network 912 via a 

suitable transceiver device 914, to enable access to e.g. the Internet or other 
network systems such as Local Area Network (LAN) or Wide Area Network (WAN). 

The computer module 902 in the example includes a processor 918, a 
10 Random Access Memory (RAM) 920 and a Read Only Memory (ROM) 922. The 
computer module 902 also includes a number of Input/Output (I/O) interfaces, for 
example I/O interface 924 to the display 908 (or where the display is located at a 
remote location), and I/O interface 926 to the keyboard 904. 

15 The components of the computer module 902 typically communicate via an 

interconnected bus 928 and in a manner known to the person skilled in the relevant 
art. 

The application program is typically supplied to the user of the computer 
20 system 900 encoded on a data storage medium such as a CD-ROM or floppy disk 
and read utilising a corresponding data storage medium drive of a data storage 
device 930. The application program is read and controlled in its execution by the 
processor 918. Intermediate storage of program data maybe accomplished using 
RAM 920. 

25 

In the foregoing manner, a method for generating shadows utilising 
trapezoidal shadow maps is disclosed. Only several embodiments are described. 
However, it will be apparent to one skilled in the art in view of this disclosure that 
numerous changes and/or modifications may be made without departing from the 
30 scope of the invention. 
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Annexure A 

light's vertex program: 

UVP1.0 

# c[0-3] : NJT 

# c[8-ll] : light's projection and modelview matrix 

# c[12-15]: world matrix 

# c [16-19]: inverse world matrix 

# v[OPOS] : object position 

# o[HPOS] : result vertex 

# transform v[OPOS] into world space and store result in R4: 

# R4 = W * v[OPOS] 

DP4 R4.x, c[12], v[OPOS]; 
DP4 R4.y, c[13], v[OPOS] ; 
DP4 R4.z, c[14], v[OPOS]; 
DP4 R4.w, c[15], v[OPOS]; 

# transform R4 into light's post-perspective space and store result in Rl: 

# Rl as PJL * C_Ii * (R4) = P_L * C_L * W * v[OPOS] 

DP4 Rl.x, c[8], R4; 
DP4 Rl.y, c[9], R4; 
DP4 Rl.z, c[10], R4; 
DP4 Rl.w, c[ll], R4; 

# store this Rl in the first texture coordinate: 

# o[TEX0] = PJL * CJL * W * v[OPOS] 

MOV o[TEX0] , Rl; 

# transform R4 into trapezoidal space: 

# o[HPOS] = N_T * PJL * CJL * W * v[OPOS] 

DP4 o[HPOS].x, c[0], R4; 
DP4 o[HP0S] .y, c[l] , R4; 
DP4 o[HPOS] .z, c[2] , R4; 
DP4 o[HP0S].w, c[3], R4; 

MOV o[COL0], v[COL0]; 

END 

light's fragment program: 

I ! FP1 . 0 

# f [WPOS] : fragment in trapezoidal space (window position) 

# f [TEXO] : fragment's position in post-perspective space of the light 

RCP RO.x, f[TEX0].w; # ro.x « 1 / w_L 

MUL Rl, f[TEX0], RO.x; # Rl = (x^L/w_L, y_L/w_L, z_L/wJL, 1) 

MAD R2.z, Rl.z, 0.5, 0.5; # R2 . z = Rl.z * 0.5 + 0.5; depth is now in 

# the range [0;1] 

MUL o[DEPR], R2.z, R2.z; # o[DEPR] » zJL/wJL * 0.5 + 0.5; replace 

# "z_T" with "z_L" 

MOVo[COLR], f[COL0]; 



END 
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Annexure B 

void display () { 

// 1st pass: TSM generation 

// as described with reference to Figure 6 in the detailed description, 
// as a first step we have to calculate a trapezoid based on the 
// eye frustum E. 

// The four vertices are stored in t_0, t_l, t_2, t_3 

calculateTrapezoid(&t_ 0, &t_l, &t_2, &t_3, P_L, C_L, E) ; 

// ...after that N_T is calculated as described above 

calculateTrapezoidalTransformation(&N_T, t_0, t_l, t_2, t_3) ; 

glViewport ( 0 , 0 , shadowmapWidth, shadowmapHeight ) ; 

// Bind the above vertex program. . . 

glBindProgramNV (GL_VERTEX_PROGRAM__NV f vpLight ) ; 

// . . .and bind the above fragment program 

glBindProgramNV (GL__FRAGMENT_PROGRAM_NV, f pLight ) ; 

glMatrixMode (GL_PROJECTION) ; // store N_T in G^_PROJECTION 
glLoadMatrixf (N_T) ; 

glTrackMatrixNV ( GL_VERTEX_PROGRAM__NV, 0, GL_PROJECTION, GL_IDENTITY__NV) ; 

glMatrixMode (GL_MATRIX1_NV) ; // store in P_L * CJL and track in GL_MATRIX1_NV 
glLoadMatr ixf ( P_L) ; // light ? s projection matrix, e.g. achieved with 

// gluPer specti ve ( ) 
glMultMatrixf (C_L) ; // light T s camera matrix, e.g. achieved with 

// gluLookAtO 

glTrackMatrixNV ( GL_VERTEX_PROGRAM_NV, 8 , GL_MATRIX1_NV, GL_IDENTITY_NV) ; 

glMatrixMode (GL_MODELVIEW) ; // store the model view matrix in 

// GLJtfODELVIEW 

glLoadldentity ( ) ; 

glTrackMatrixNV (GL_VERTEX_PROGRAM_NV, 12 , GL_MODELVIEW , GL_IDENTITY_NV) ; 
renderScene ( ) ; 

// Like in the standard shadow map approach we copy the depth buffer 
// into a texture: 

CopyDepthBuf f erToTexture ( ) ; 



// 2nd pass: render scene from eye's position and project TSM texture 
// over the scene 



SwapBuf fers ( ) ; 
} 



